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Since the late 1980s, state court judges in over twenty states, deriving their authority from the education 


clauses of their respective state constitutions, have struck down school finance systems as not “adequate.” 


Pointing to evidence of unacceptable student achievement outcomes, especially among poor and disadvan- 


taged students, advocates of court intervention argue that student outcomes can be improved with addi- 


tional funding; that is, all children can learn, given sufficient resources. Many courts have accepted this 


premise and have ordered legislatures to provide unprecedented increases in state appropriations for K-12 


schools. Unfortunately, the track record of these judicial interventions suggests that increased funding 


without other more fundamental changes typically does not lead to improved student performance. 


i. the premise underlying “educational 
adequacy” lawsuits—that more court-ordered 
resources will result in higher outcomes—is 
accepted by many in the education community, 
almost no one has seriously examined the empiri- 
cal evidence to determine its validity. Several of 
the adequacy remedies ordered by the courts have 
been in place for a decade or more, yet no one, to 
our knowledge, has compared the pre- and post- 
remedy student outcome data to determine whether 
student achievement has actually improved in 
response to the significantly increased funding and 
resources made available by virtue of the courts’ 
orders. Instead, most commentators point out the 
obvious—that increased funding has led to addi- 
tional programs and personnel and new and 
improved facilities. The most important question— 
has student achievement improved as a result of 
the court interventions?—remains a subject barely 
addressed by the education research community. 
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Nor have the courts seemed too interested in 
this vital question. While courts are often guided in 
their decisions by what judges in other states have 
done, rarely has any court considered whether the 
remedies in other states have actually produced 
improved student achievement. Rather than exam- 
ining the relevant achievement outcomes of other 
states, judges tend to rely on the testimony of 
expert witnesses and school personnel who tout 
their own pet programs and predict significantly 
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better outcomes if such programs are funded and properly 
implemented. Indeed, even when judging the effective- 
ness of their own previously ordered remedies, courts 
rarely examine the remedy’s effect on student achieve- 
ment. For example, the Wyoming Supreme Court, after 
more than a decade of unprecedented funding increases 
for Wyoming’s public schools, declared that the state legis- 
lature was in compliance with the state constitution. Yet, 
in its related lengthy 2008 opinion, the court barely dis- 
cussed whether student performance had improved. The 
court’s only words on the subject were that “at the time of 
trial Wyoming ranked as one of the highest states in the 
nation for schools making adequate yearly progress under 
the federal No Child Left Behind programs.” This was 
hardly surprising, given Wyoming’s relatively advantaged 
student population. No inquiry was made to determine if 
achievement levels in Wyoming had actually improved 
during the course of the extensive remedy in any mean- 
ingful way.! 

A few scholars have attempted to determine the 
effect of court remedies on student achievement, but 
these studies are handicapped by changing state tests and 
typically concentrate on only a relatively brief period 
when such remedies have been in place.” No attention 
has been given to the obvious question: how are students 
doing now compared with their performance prior to the 
implementation of the remedy? 

Four states—Kentucky, Wyoming, New Jersey, and 
Massachusetts—implemented substantial court-ordered 
remedies a decade or more ago, providing an opportunity 
to evaluate the impact of significant judicial interven- 
tions over several years. It is nearly impossible to com- 
pare each state’s achievement tests reliably. All four 
states, however, have participated in the National 
Assessment of Educational Progress (NAEP) testing pro- 
gram (known as the nation’s report card) for enough 
years that we can examine their students’ pre- and post- 
remedy achievement levels. Using NAEP test scores, we 
can compare changes in student achievement levels 
among these states and in relation to students nation- 
wide. Moreover, scores on the federally administered 
NAEP tests are less susceptible to manipulation by state 
authorities eager to augment results.3 

During the period of time we examine—from 1992 to 
2007—NAEP scores in elementary and middle schools 
increased in almost every U.S. state, regardless of whether 
the state undertook reforms mandated by adequacy law- 
suits. Thus, improved scores by themselves tell us little; 
the more telling indicator of success is how well students 


in each of these four states performed on NAEP in com- 
parison to other states in the national pool. Given the 
substantial funding increases in these four states, we 
might expect these students to have outperformed their 
“nonadequacy” peers by a significant margin. 

In examining test scores, we are most concerned 
about the achievement scores of at-risk students—the 
economically disadvantaged and minority students who 
are the primary target of adequacy remedies. Although 
pre-remedy NAEP scores broken down for economically 
disadvantaged students are not available, NAEP does 
report 1992 scores for black and Hispanic students in 
fourth grade reading and math and eighth grade math. 
Using the NAEP data, we can determine whether the 
relative achievement of black and Hispanic children in 
reading and math has improved since the inception of 
the remedy in each state. 


Kentucky 


Kentucky has long been cited by proponents of judicial 
intervention as a model of what adequacy cases can 
accomplish. The 1989 Rose decision found that the Ken- 
tucky education system did not comply with the state 
constitution and ordered, among other things, structural 
changes and increased funding.* This case also heralded 
in the golden age of successful adequacy litigation, last- 
ing from 1990 to 2004. However, the plaudits showered 
on the Kentucky remedy relate mostly to the structural 
changes it brought about and not to success in improv- 
ing the achievement of students. On this front, the 
NAEP scores reflect little or no progress. 

We began our analysis with the state’s largest minority 
group. Black students constitute about 11 percent of the 
state’s public school enrollment and perennially score sig- 
nificantly below the state’s white students on standard- 
ized tests. Unfortunately, the adequacy remedy has done 
little to reverse this persistent black-white achievement 
gap. If anything, Kentucky’s black students have fallen 
even further behind the nation during the course of the 
remedy. As indicated in figure 1, from 1992, when the 
remedy began, through 2007, black students’ scores 
increased on each of the three tests, but at a rate signifi- 
cantly lower than black students’ scores nationwide. For 
example, in 1992, the state’s fourth grade reading scores 
for black students were five points above the national 
average for black students; by 2007, they had dropped to 
the national average. In math, fourth graders were eight 
points above the national average for black students in 


FIGURE 1 
KENTUCKY AND NATIONAL NAEP TRENDS 
FOR BLACK STUDENTS, 1992-2007 


FIGURE 2 
KENTUCKY AND NATIONAL NAEP TRENDS 
FOR WHITE STUDENTS, 1992-2007 
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Progress, “The Nation’s Report Card,” available at www://nces.ed.gov/ 
nationsreportcard (accessed May 29, 2009). 


1992 but had fallen to three points below it by 2007. 
Kentucky’s black eighth grade students fared no better. In 
1992, they were noticeably above the national average 
for black students; by 2007, they had fallen below it. 

As shown in figure 2, the state’s white students’ scores 
did improve somewhat over the course of the remedy, 
but their scores on all three tests remain significantly 
below the national average for white children. From 
1992 through 2007, their scores increased slightly more 
than the national average for white students on two tests 
(fourth grade reading and eighth grade math) and mir- 
rored the national gain on one test (fourth grade math). 

A 2007 analysis of NAEP scores in Kentucky concludes 
that since such scores have increased in the state since 
1998 in reading and since 2000 in math for all students— 
including black students and economically disadvantaged 
students—the remedy may be having a positive effect.5 
However, as noted earlier, NAEP scores in virtually every 
state increased during this period, regardless of whether 
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the state’s students enjoyed significantly enhanced funding 
or other remedial measures; therefore, the mere fact that 
the scores increased tells us little about the success of the 
remedy. Moreover, using these same test scores, time 
period, and subgroups of children, we still find that Ken- 
tucky’s gains were significantly below the national aver- 
age on six tests, about the same on five tests, and above 
the national gains on only one test. 


Wyoming 


Perhaps the most dramatic court intervention occurred in 
Wyoming. In 1995, the Wyoming Supreme Court found 
the education funding system unconstitutional and 
decreed that the legislature provide whatever funds nec- 
essary to make education in the state the “best.”© A com- 
pliant legislature flush with tax revenues from the state’s 
mineral interests responded with massive increases in 
K-12 education appropriations, which drove Wyoming’s 


FIGURE 3 
WYOMING AND NATIONAL NAEP TRENDS 
FOR HISPANIC STUDENTS, 1992-2007 


FIGURE 4 
WYOMING AND NATIONAL NAEP TRENDS 
FOR WHITE STUDENTS, 1992-2007 
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per-pupil funding from just over the national average to 
among the highest in the nation, particularly when 
adjusted for regional cost differences. Despite these 
unprecedented increases in school funding, the achieve- 
ment of Wyoming’s students has largely failed to keep up 
with the nation or even with its much lower-funded, 
although demographically similar, neighboring states.” 
One of the primary targets of Wyoming’s judicial rem- 
edy was the significant achievement gap between white 
and Hispanic children, the state’s largest minority group. 
As figure 3 indicates, from 1992 to 2007, the increases 
achieved by Hispanic students in Wyoming were less 
impressive than the increased achievement by Hispanic 
students in the rest of the country on two of the three 
tests. While fourth grade scores in both reading and math 
increased, they did so at only about half the rate for His- 
panic students nationwide. In the eighth grade, the gains 
on the math test made by the state’s Hispanic students 
surpassed the gains made nationally by Hispanic students. 
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White students constitute almost 90 percent of the 
student population in Wyoming, so we also examined 
their performance during the course of the remedy to see 
if success could be claimed for the vast majority of the 
students in the state, regardless of the disappointing 
results for its largest minority group. However, as figure 4 
shows, the state’s white students failed to keep pace with 
white students nationally. On all three tests, the average 
test score increases in the nation for white students were 
greater than those achieved by Wyoming’s white stu- 
dents. For example, in 1992, Wyoming’s fourth graders 
were two points above the national average in reading; 
by 2007, they were two points below it. 


New Jersey 
New Jersey has been involved in school finance litiga- 


tion over its K-12 education system since 1970. In both 
duration and expense, New Jersey’s remedial efforts stand 


out. New Jersey’s most recent judicial remedy, FIGURE 5 
developed in the mid-1990s, is different than the NEW JERSEY AND NATIONAL NAEP TRENDS 
other three states we evaluate because it is not FOR BLACK STUDENTS, 1992-2007 


statewide; it applies to only thirty-one of the state’s a 
poorest school districts (out of over six hundred 
school districts in the state). These thirty-one 
“Abbott districts,” named after the court case,® are 
the only beneficiaries of over $1.5 billion a year in oe 
additional funding under the court order. As a result, 
they are by far the highest-funded school districts in 
an already high-spending state,? outspending both the an 
wealthiest and other poor districts by thousands of 
dollars per student. 

The Abbott districts were chosen because they =e 


had concentrated poverty and because they were pro- 
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thirty-one Abbott districts. Nevertheless, we believe 


New Jersey’s NAEP scores can tell us a lot about the Source: U.S. Department of Education, National Assessment of Educational 


success of the Abbott remedy. The Abbott districts Progress, “The Nation’s Report Card,” available at www://nces.ed.gov/ 


: . : nationsreportcard (accessed May 29, 2009). 
educate approximately half of the black and Hispanic ' 


students in the state. Once again we can compare test 


scores between 1992, before the bulk of the remedial remedy. One would be hard-pressed, however, to argue 

dollars began to pour into the Abbott districts, and from these numbers that the remarkable levels of fund- 

2007, after the districts had enjoyed many years of ing enjoyed by the Abbott districts (in which spending 

higher funding and when the most recent test results per pupil can exceed $20,000 per year) have led to any 

became available. dramatic improvements. At best, New Jersey’s black stu- 
The picture we find is a mixed one, with little evi- dents appear to be holding their own. 

dence that the state’s black students have progressed However, even that modest assessment is problematic 


much, if at all, relative to black students nationwide, but —_ because it essentially depends on one data point—the 
with some positive indications that its Hispanic students 2007 test scores. Virtually all of the progress made by the 


have made significant progress. As shown in figure 5, state’s black students has occurred in the last two years— 
from 1992 through 2007, the scores for fourth grade from 2005 to 2007. Before 2005, the state’s black fourth 
black students in New Jersey on the NAEP reading test graders lost significant ground, gaining only a single 
increased by fourteen points, slightly more than the point from 1992 through 2005 on the fourth grade read- 
twelve-point increase nationwide among black students ing test, compared to a national gain of eight points 


during the same period. On the math test, the state’s stu- among black students during the same period. The same 
dents gained thirty-four points, compared to a national was true on the math test, in which the gains made by 
gain of thirty points. On the surface, New Jersey's black the state’s black fourth graders also lagged behind the 
fourth grade students appear to have done a little better nation through 2005. On the 2007 test, reading scores 
than the national average over the fifteen years of the increased by thirteen points, more than in any other 


FIGURE 6 
NEW JERSEY AND NATIONAL NAEP TRENDS 
FOR HISPANIC STUDENTS, 1992-2007 


registered higher gains from 1992 to 2007 than His- 
panic students nationwide. The performance of the 
state’s Hispanic students on the fourth grade reading 
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state, and math scores by nine points, making up for 
the lack of progress made during the first thirteen years 
of the period and putting them slightly ahead of the 
progress made nationally. Proponents of the remedy rely 
on the 2007 scores to argue that the court remedies are 
finally having a positive effect. We hope that is the case, 
but even accepting the 2007 scores at face value, the 
NAEP tests indicate only modest progress by the black 
fourth grade students. Moreover, virtually no one claims 
any significant progress at the middle school level. As 
indicated in figure 5, the scores of the state’s black 
eighth grade students increased twenty-two points from 
1992 through 2007, while nationally their scores rose 
twenty-three points. 

On a brighter note, New Jersey’s Hispanic students, 
almost half of whom go to school in the Abbott districts, 
appear to have made more significant progress since the 
remedy began. As reflected in figure 6, on all three of the 
NAEP tests we examined, the state’s Hispanic students 


Eighth grade 
reading math math 


and eighth grade math tests was especially notable. 
Moreover, unlike the black students’ scores, there 
were no extraordinary gains on the 2007 test that cast 
doubt on the validity of the patterns we observed.!° 

In 2008, New Jersey enacted a new financing for- 
mula, and the case returned to the courts to deter- 
mine whether the special funding status of the 
Abbott districts should continue. A May 29, 2009, 
ruling by the New Jersey Supreme Court appears to 
signal an eventual end to the Abbott case. Although 
retaining supervision for three years, the court has 
placed a limit on the increases that go to Abbott dis- 
tricts and has called for integrating the Abbott dis- 
tricts with other districts in the state under its new 
funding formula. 


Massachusetts 


Massachusetts is, for the most part, the success story 
among the four states we examined. In 1993, the 
Massachusetts legislature enacted a host of reforms in 
response to the McDuffy case,!! declaring its system 
of education unconstitutional. Over the next decade, 
the legislature tripled the funding of the state’s public 
schools—from approximately $3 billion to $10 billion— 
and adopted a number of other strong reform meas- 
ures including “a rigorous regimen of academic 
standards, graduation exams, and accountability.”!2 Thus, 
Massachusetts is not an example of pure funding increases 
but instead of fundamental changes in schools along with 
increased resources. To us, this is very different, and the 
results confirm that perspective. 

Over the course of these remedies, the achievement 
scores of white and Hispanic students in Massachusetts 
have outpaced the comparable national scores. As indi- 
cated in figure 7, the state’s white students have done 
particularly well, posting test score increases well above 
the national average, particularly in eighth grade math. 
When the remedy began, the state’s white eighth 
graders’ scores were only one point above the national 
average; by 2007, they were fifteen points above the 
national average. 

Massachusetts’s Hispanic students, one of the state’s 
two large minority groups, also made impressive gains 
compared to Hispanic students nationwide. As figure 8 
shows, the math scores of the state’s Hispanic fourth 


FIGURE 8 
MASSACHUSETTS AND NATIONAL NAEP TRENDS 
FOR HISPANIC STUDENTS, 1992-2007 


FIGURE 7 
MASSACHUSETTS AND NATIONAL NAEP TRENDS 
FOR WHITE STUDENTS, 1992-2007 
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Source: U.S. Department of Education, National Assessment of Educational 
Progress, “The Nation’s Report Card,” available at www://nces.ed.gov/ 
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graders and eighth graders moved from several points 
below the national average to several points above dur- 
ing the course of the remedy. 

This pattern of progress, however, does not hold true 
for the state’s black students, its second largest minority 
group. While Massachusetts’s black students’ scores 
exceed the national average for black students, these 
scores were even further above the national average in 
1992—-when the remedy commenced on two of the 
three tests (fourth grade reading and eighth grade math). 
Therefore, it is difficult to see what, if any, progress black 
students have made as a result of the remedy relative to 
white students or to other states (see figure 9). In 1992, 
the state’s white-black achievement gap on eighth grade 
math was thirty-four points, compared to a national gap 
of forty points. By 2007, the national gap had decreased 
to thirty-one points, while Massachusetts’s gap had 
widened to forty-one points. This may not be quite as bad 
as it seems because part of the gap-widening was caused 


by significant gains in white students’ scores, as opposed 
to decreased black students’ scores, but the state’s white- 
black achievement gap remains a serious problem that 
the remedy has failed to alleviate. 


Conclusion 


The results in three of the states—Kentucky, Wyoming, 
and New Jersey—are disappointing for anyone hoping 
that court-ordered funding increases will lead to dramatic 
student achievement gains. This is especially true for 
black students: we found no evidence in these four states 
of significant progress by black students. Indeed, in both 
Massachusetts and Kentucky, black students have lost 
substantial ground as compared to national averages dur- 
ing the course of these judicial remedies. 

The news is mixed for those states with large Hispanic 
student populations. In Wyoming, Hispanic students 
have not kept up with the nation as a whole, while in 


FIGURE 9 
MASSACHUSETTS AND NATIONAL NAEP TRENDS 
FOR BLACK STUDENTS, 1992-2007 
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Massachusetts and New Jersey, their scores have improved 
relative to Hispanic students in the rest of the country. 
Results for white students are also varied. In Massachu- 
setts, white students clearly did well compared with the 
white students across the country. In Wyoming and Ken- 
tucky, however, there is little evidence of significant 
progress among white students relative to the nation as a 
whole. (Understandably, few white students have bene- 
fited from the remedy in New Jersey because it is directed 
at the predominately minority Abbott districts.) 

The remedies arising from adequacy lawsuits in these 
four states have been the most sweeping in the nation, 
both in terms of the time they spanned and the funding 
increases they generated. Advocates of court-ordered 
funding increases as a means to raising achievement, 
particularly among disadvantaged children, would logi- 
cally turn to these states to find evidence for their cause. 
Unfortunately, the evidence does not support any sub- 
stantial improvements in performance resulting from 


results. With more fundamental changes, however, 
Massachusetts indicates the possibility of obtaining 
true performance increases. !4 
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